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Measuring  Pulse  Rate  Variability  using  Long-Range,  Non-Contact 

Imaging  Photoplethysmography 

Ethan  B.  Blackford,  Member,  IEEE ,  Alyssa  M.  Piasecki,  and  Justin  R.  Estepp,  Member,  IEEE 


Abstract —  Camera-based  measurement  of  the  blood  volume 
pulse  via  non-contact,  imaging  photoplethysmography  is  a  very 
popular  approach  for  measuring  pulse  rate  using  a  remote 
imaging  sensor.  Comparatively  less  attention  has  been  paid  to 
the  usefulness  of  the  method  for  measuring  features  of  pulse 
rate  variability,  and  even  less  focus  has  been  put  on  the 
accuracy  of  any  cardiac  activity  feature  that  can  be  achieved  at 
long  imager-to-subject  distances.  In  this  study,  video  was 
recorded  from  19  participants,  while  at  rest,  at  a  distance  of  25 
meters  from  the  imaging  sensor.  A  digital  camera  was  used  to 
record  video  while  cardiovascular  measures  of  both  electrical 
and  optical  physiological  ground  truth  were  recorded.  Pulse 
rate  data  obtained  from  the  imager  using  a  common  blind 
source  separation  and  periodogram  approach  were  compared 
to  physiological  ground  truth  signals.  The  quality  of  the 
recovered  blood  volume  pulse  morphology  was  sufficient  to 
calculate  time-domain  measures  of  pulse  rate  using  inter-pulse 
interval  (IPI)  time  series.  Following  this,  several  features  of 
pulse  rate  variability  were  calculated  from  the  IPI  time  series 
and  compared  to  those  calculated  from  the  corresponding 
physiological  ground  truth  signals.  Use  of  the  time-domain  data 
as  compared  to  the  periodogram  approach  to  measure  pulse 
rate  reduced  the  error  in  the  estimate  from  1.6  to  0.2  beats  per 
minute.  Correlation  analysis  (r2)  between  the  camera-based 
measures  of  pulse  rate  variability  and  ECG-derived  heart  rate 
variability  ranged  from  0.779  to  0.973;  these  results  are  of 
comparable  outcome  to  those  obtained  at  imager-to-subject 
distances  of  no  more  than  3  meters.  This  study  demonstrates 
that  pulse  rates  of  less  than  one  beat-per-minute  error  can  be 
obtained  w  hen  the  recovered  blood  volume  pulse  morphology  is 
of  adequate  quality  to  resolve  systolic  onsets  for  individual 
cardiac  cycles.  Further,  this  approach  can  yield  data  of  very 
promising  quality  for  estimating  measures  of  pulse  rate 
variability. 

I.  Introduction 

Photoplethysmography  (PPG),  first  pioneered  in  the 
1930’s,  is  a  low  cost,  noninvasive  method  of  detecting 
changes  in  blood  volume  using  variations  in  transmitted  or 
reflected  light.  In  either  case,  changes  in  light  absorption 
caused  by  the  blood  volume  pulse  (BVP)  wave  are  measured 
using  a  photodetector.  A  more  recently  developed  technique, 
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imaging  photoplethysmography  (iPPG),  uses  an  image 
sensor  to  measure  the  same  phenomenon  and  can  provide 
both  spatial  and  temporal  information  about  the  BVP  wave. 
iPPG  may  present  particular  advantages  over  traditional, 
contact  PPG  for  incorporation  into  telemedicine  applications 
or  for  patients  with  skin  sensitivities  (e.g.  burn  patients  or 
neonates  [  1  J-[3 J).  Unlike  the  single  photodetectors  employed 
in  traditional  PPG,  iPPG  also  has  the  ability  to  take 
measurements  over  large  areas  of  skin  for  increased  signal- 
to-noise  ratios,  measuring  pulse  transit  time  [4J,  mapping 
skin  perfusion  [5],  [6],  wound  healing  [7J,  or  blood  oxygen 
saturation  [8J.  [9J.  Several  topical  reviews  have  provided 
insight  into  the  current  state  of  the  art,  challenges,  and  areas 
for  future  research  in  the  domain  of  iPPG  [10]-[16J.  In  both 
contact  and  noncontact  methods,  the  varying  light  intensities 
are  processed  and  used  to  represent  changes  in  vascular 
blood  volume.  Onset  of  the  systolic  phase  of  the  cardiac 
cycle  in  the  arterial  system  can  be  observed  in  the  BVP  and 
can  be  used  to  extract  important  cardiovascular  measures 
such  as  pulse  rate  (PR),  pulse  rate  variability  (PRV),  and 
respiration  rate.  Other  measures  such  as  peripheral  blood 
oxygen  saturation  (SpO:)  and  blood  pressure  may  be 
achievable  via  iPPG,  as  well. 

PRV,  in  particular,  contains  valuable  information  about 
the  autonomic  nervous  system  and  sympathetic/ 
parasympathetic  activation  which  are  indicative  of 
cardiovascular  health  and  stress  states.  While  heart  rate 
variability  has  traditionally  been  measured  using 
electrocardiography  (ECG),  several  studies  have  shown  that 
PRV  extracted  from  PPG  can  often  be  used  as  a  surrogate 
for  heart  rate  variability  (HRV),  especially  under  resting 
conditions  [17J,  [18J.  In  order  to  measure  pulse  rate 
variability  from  an  acquired  PPG  waveform,  cardiac 
intervals  must  be  measured  from  individually  identified  BVP 
waves.  The  accurate  identification  of  the  QRS  complex  in 
ECG  is  relatively  straightforward  as  compared  to  the  reliable 
identification  of  systolic  onset  in  the  PPG  wave.  In  any  case, 
consistent  identification  of  individual  cardiac  cycle  onsets, 
with  high  temporal  resolution,  is  of  utmost  importance  for 
the  accurate  measurement  of  cardiac  variability. 

Various  time-  and  frequency-domain  measures  of  HRV 
are  common  with  standards  for  their  measurement 
established  by  a  joint  international  taskforce  [19J. 
Commonly  used  time-domain  indices  include  standard 
deviation  of  successive  normal  to  normal  (NN)  cardiac 
intervals  (SDNN)  and  the  square  root  of  the  mean  squared 
differences  of  successive  NN  intervals  (RMSSD).  SDNN 
reflects  the  overall  variability  in  a  given  segment  while 
RMSSD  estimates  short-term  components  of  HRV. 
Frequency-domain  indices  include  metrics  such  as  low- 
frequency  (LF)/  Traube-Hering-Mayer  (THM)  variability  in 
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the  0.04  to  0.15  Hz  range  and  high-frequency  (HF)/ 
respiratory  sinus  arrhythmia  (RSA)  variability  in  the  0.15  to 
0.4  Hz  range  [20],  HF  primarily  denotes  effects  of 
respiration  and  parasympathetic/  vagal  input  to  the  cardiac 
system;  alternatively,  LF  is  more  challenging  to  interpret  but 
is  known  to  contain  information  about  sympathetic  input  to 
the  cardiac  system.  The  potential  to  evaluate  these  measures 
in  a  non-contact  and  unobtrusive  manner  is  a  great 
advantage  for  iPPG  based  methods. 

Previously,  we  demonstrated  successful  measurement  of 
windowed  pulse  rate  estimates  using  long-range  imaging 
photoplethysmography  for  stationary  subjects  and  imager-to- 
subject  distances  of  25,  50,  and  100  meters.  Increased  error 
in  the  pulse  rate  estimates  was  seen  at  distances  of  50  and 
100  meters  and  was  likely  due  to  decreased  reflected  light 
availability  at  the  image  sensor  with  longer  focal-lengths  and 
smaller  regions  of  interest  in  the  image.  Additionally,  the 
inUoduction  of  systematic  error  resulting  from 
measurements  of  PR  using  power  spectral  analysis  of  the 
iPPG  waveform  was  noted  [21J.  Herein  we  expand  on  the 
analysis  of  that  dataset  and  demonstrate  the  use  of  long- 
range  imaging  pholoplethysmography  at  a  distance  of  25 
meters  for  the  measurement  of  one-minute  windowed 
estimates  of  pulse  rate  (using  individual  cardiac  cycle 
identification)  as  well  as  pulse  rate  variability  measured  over 
five-minute  windows  using  SDNN,  LF,  and  HF.  Gold- 
standard  comparisons  were  derived  from  simultaneous 
measurements  of  contact  ECG  and  fingertip  reflectance 
PPG.  The  iPPG  signals  measured  at  50  and  100  meters  were 
deemed  to  be  too  noisy  to  analyze  for  identification  of 
individual  cardiac  intervals.  While  several  previous  studies 
have  investigated  the  estimation  of  HRV  using  traditional 
PPG  [17J,  [18],  [24J-[29]  or  iPPG  at  relatively  short 
distances  ranging  from  several  centimeters  to  3  meters  [30J- 
[35],  this  is,  to  our  knowledge,  the  first  demonstration  using 
long-range  iPPG  to  measure  pulse  rate  variability. 

II.  Methods 

A.  Equipment  Setup 

Video  imagery  used  in  this  study  came  from  a  subset  of 
data  previously  collected  by  the  authors  [21]  and  was 
recorded  using  high-quality,  mirrorless  digital  cameras 
(Panasonic  Lumix  DMC-GH4,  Panasonic,  Kadoma,  Osaka, 
Japan)  equipped  with  lully-manual,  super-telephoto  lenses 
(650Z-B,  Rokinon,  New  York,  NY,  USA).  The  imager  was 
mounted  to  a  tripod  1.2  meters  above  floor  level.  From  the 
original  dataset,  only  the  recordings  with  an  imager-to- 
subject  distance  of  25  meters  were  used  for  this  study. 

The  imager  was  positioned  to  center  the  participant 
horizontally  in  the  image  with  their  entire  head  and  as  much 
of  their  upper  torso  in  the  frame  as  possible.  To  achieve  this, 
camera  and  lens  parameters  were:  650mm  focal  length, 
shutter  speed  of  l/30s,  400  ISO,  3200K  white  balance,  a 
resolution  of  1920x1080  pixels,  and  a  frame  rate  of  29.97  fps. 
Videos  were  recorded  with  all-intra  frame,  H.264 
compression  at  a  maximum  bit  rate  of  200  Mbps  to  a  .MP4 
file  on  an  internal  SD  card  (64GB  Extreme  PRO  SDXC 
UHS-1I,  SanDisk,  Milpitas,  California,  USA).  Fig.  1  shows 
the  experimental  setup. 


Figure  1.  Characteristic  images  of  the  experimental  setup.  The  top  image 
image  was  captured  using  a  650mm  super-telephoto  lens  and  is 
characteristic  of  the  frames  analyzed  in  this  study.  The  bottom  image 
shows  the  imager  setup  at  a  distance  25m  from  the  participant. 

The  experiment  took  place  within  a  long,  interior  corridor 
of  an  office  building  with  normal,  ambient  fluorescent 
lighting  and  a  small  amount  of  exterior  light  entering  through 
windows  on  one  side  of  the  corridor.  Two  1000W,  3200K, 
quartz-halogen  light  sources  (QL-1000,  Savage  Equipment 
Products,  Chandler,  AZ,  USA)  mounted  inside  soft  box 
diffusers  were  used  as  the  illumination  source.  Each  light 
source  was  placed  2m  in  front  and  0.6m  to  either  side  of  the 
subject,  2m  above  the  ground,  and  directed  toward  the 
subject’s  face.  The  average  experimental  lighting  conditions 
measured  970  lux  using  a  Litemaster  Pro  L-478DF  (Sekonic, 
North  While  Plains,  New  York,  United  States).  A  solid  gray 
backdrop  was  placed  behind  the  subject  in  order  to  reduce 
any  signal  noise  from  the  image  background. 

Traditional,  contact  PPG  ground-truth  signals,  along  with 
synchronous  recording  of  ECG,  respiration,  galvanic  skin 
response  (GSR),  and  a  push-button  trigger,  were  obtained 
using  an  ActiveTwo  eleclrophysiological  data  acquisition 
system  (BioSemi  B.V.,  Amsterdam,  The  Netherlands)  in 
which  a  single,  continuous  file  was  recorded  to  a 
workstation-class  laptop  running  the  acquisition  software 
(ActiView,  BioSemi  B.V.,  Amsterdam,  The  Netherlands). 
Fingertip  reflectance  PPG  was  measured  on  the  ring  finger  of 
the  non-dominant  hand  from  a  fingertip  reflectance  sensor 
(MLT1020FC  IR  Plelhysmograph  Finger  Clip, 
ADIntrumenls  Inc.,  Colorado  Springs,  Colorado,  USA)  and 
ECG  was  measured  from  a  bipolar  pair  of  active  electrodes 
positioned  on  the  left  clavicle  and  upper  sternum.  Respiratory 
effort,  galvanic  skin  response  (GSR),  and  video  from  three 
GoPro  cameras  positioned  along  a  semi-circle  in  front  of  the 
subject  were  also  recorded  for  each  trial  but  not  included  in 
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this  analysis  and,  therefore,  not  described  in  further  detail 
here. 

B.  Subjects 

A  total  of  twenty-three  participants  (1 1  male,  age  range  of 
19-47  years  old,  mean  age  of  25.8  years)  participated  in  this 
study  after  providing  voluntary  consent.  One  participant  was 
excluded  from  the  analysis  due  to  a  self-identified  cardiac 
abnormality;  in  addition,  three  more  participants  were 
excluded  due  to  low  quality  iPPG  waveforms  obtained  during 
experimentation.  Fig.  2  provides  an  example  of  the 
differentiation  between  low-  and  high-quality  data  for  the 
exclusion  process.  This  resulted  in  a  total  of  nineteen 
participants  available  for  analysis. 

Minute  2  -  Sample  Time  Series 


Time  (s) 

Minute  2  -  Sample  Time  Series 


Figure  2.  Comparison  of  high-  and  low-quality  data  for  exclusion 
purposes.  The  top  chart  depicts  high-quality  data  in  which  the  iPPG 
waveform  closely  correlates  with  ground-truth  ECG  and  PPG  signals. 
The  bottom  chart  depicts  low-quality  data  excluded  from  analysis  due  to 
low  correlation  between  waveforms.  Note:  As  displayed,  systolic  onset 
in  the  PPG  time  series  is  represented  as  a  valley  while  it  is  a  peak  in  the 
iPPG  time  series. 

The  experimental  protocol  was  reviewed  and  approved  by 
the  Air  Force  Research  Laboratory  Institutional  Review 
Board  and  performed  in  accordance  with  all  relevant 
institutional  and  national  guidelines  and  regulations.  All 


prospective  participants  received  a  study  briefing  and 
completed  comprehensive  written  informed  consent  prior  to 
their  voluntary  participation.  Participants  were  compensated 
for  their  time  unless  otherwise  employed  by  the  Department 
of  Defense  and  in  duty  status  at  the  time  of  their 
participation.  Skin  tone,  hairstyle,  facial  hair,  clothing, 
glasses,  piercings,  and  use  of  skin  or  beauty  products  were 
recorded  but  not  otherwise  used  for  analysis  or  screening 
purposes. 

C.  Experimental  Design 

Four  trials  were  performed  for  each  subject  with  each  trial 
lasting  approximately  five  minutes  and  twenty  seconds.  Both 
the  first  and  last  ten-second  buffer  segments  were  excluded 
from  the  analysis.  Subjects  were  asked  to  look  straight  ahead 
and  remain  as  still  as  possible  during  each  trial.  Of  the  full 
trial  set  [21],  a  single,  randomly-selected  trial  recorded  at  a 
distance  of  25  meters,  per  participant,  was  used  for  this 
analysis. 

D.  Ground  Truth  -  ECG  and  PPG  Signals 

Raw  ground  truth  ECG  and  PPG  signals  were  processed 
into  cardiac  interval  time  series  and  subsequently  windowed 
heart  and  pulse  rates  using  custom  software  written  in 
MATLAB  2011b  (The  Mathworks  Inc.,  Natick, 
Massachusetts,  USA).  Individual  trials  within  the  video  file 
were  separated  using  the  push-button  trigger  from  the 
ActiView  software  and  synchronized  with  the  raw  ground 
truth  signals,  sampled  at  16  kHz.  The  time-aligned  ECG  and 
PPG  signals  were  downsampled  to  1200  Hz  and  filtered  with 
a  zero-phase,  elliptical,  bandpass  filter  with  a  pass  band  of 
0.3-90  Hz  and  0.3-16  Hz,  respectively.  The  downsampled, 
bandpass-filtered  signals  were  then  normalized  to  zero-mean 
and  unit-variance. 

An  automated  R-wave  detection  algorithm  [36],  [37]  was 
used  to  extract  individual  cardiac  cycle  times  from  the  pre- 
processed  ECG  data  and,  similarly,  an  automated  peak¬ 
finding  algorithm  with  adaptive  thresholding  [38]  was  used  to 
detect  the  fiducial  point  of  the  preprocessed  PPG  time  series 
corresponding  to  the  beginning  of  systole.  All  results  from 
the  automated  algorithms  were  independently  reviewed  and 
hand-corrected  by  a  subject-matter  expert  (SME)  in  order  to 
identify  any  undetected  or  incorrectly  identified  points.  Using 
the  identified  points  corresponding  to  systolic  onset,  a  cardiac 
interval  time  series  was  constructed  consisting  of  inter-beat 
interval  (IB1)  and  inter-pulse  interval  (IPI)  time  series  for  the 
ECG  and  PPG,  respectively  (generically,  1X1  time  series). 
The  IXI  time  series  were  segmented  into  5,  non-overlapping, 
1 -minute  windows,  and  mean  PR  (from  PPG)  and  HR  (from 
ECG)  for  each  window  were  calculated  in  beats  per  minute 
(bpm). 

The  periodogram  method  with  a  Hamming  window  was 
used  to  estimate  mean  pulse  rates  for  each  1 -minute  window 
of  the  contact  PPG  segment,  thus  serving  as  an  additional 
ground  truth  measure  for  pulse  rate.  This  additional  measure 
allows  for  comparison  of  time-  (IPI)  and  frequency-domain 
(PSD)  methods  for  estimating  the  PPG-based  pulse  rate.  The 
pulse  frequency  was  chosen  as  the  frequency,  fnm,  with  the 
highest  power  density  occurring  in  the  range  from  0.8-2  Hz 
(approximating  48-120  bpm).  This  frequency  was  then 
converted  to  beats  per  minute  (60*fmax). 
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E.  Long  Range  iPPG  -  Image  Series  Data 

A  custom  MATLAB  analysis  package  was  used  to 
process  the  video  file  for  each  trial.  The  video  was  segmented 
into  5,  non-overlapping,  1 -minute  segments.  All  RGB  pixels 
were  averaged  over  the  entire  frame,  for  each  frame  in  a 
segment  in  order  to  produce  the  mean  RGB  time  series.  Each 
time  series  was  normalized  (wilhin-segment)  to  zero-mean 
and  unit-variance  and  bandpass  filtered  with  a  zero-phase, 
elliptical,  bandpass  filter  from  0.3-11  Hz.  Independent 
component  analysis  (ICA)  was  then  used  to  decompose  the 
normalized,  bandpass-filtered,  color-channel  signals  into 
independent  RGB  components.  Following  ICA,  all 
independent  components  were  bandpass  filtered  with  a  zero- 
phase,  elliptical,  bandpass  filter  between  0.3-6  Hz  and 
upsampled  to  1,200  Hz  using  cubic  spline  interpolation. 

An  estimate  of  signal-to-noise  ratio  (SNR)  in  the 
frequency  range  of  the  iPPG  component  signal  was  used  to 
automatically  choose  the  ICA  component  most  likely  to 
contain  BVP  information.  This  SNR  estimate  was  calculated 
using  the  periodogram  method  with  a  Hamming  window  to 
locate  the  frequency  with  maximum  power  density  within  the 
range  of  0.8-2  Hz.  The  band  power  for  the  dominant 
frequency  was  calculated  over  a  range  of  ±0.123  Hz  and 
transformed  to  relative  power  by  dividing  it  by  the 
component  signal  power  falling  outside  the  peak  frequency 
range  but  within  0.8-2  Hz.  The  independent  component  with 
the  highest  relative  power  was  chosen  as  the  pulse  rate 
component.  As  was  performed  for  fingertip  PPG,  the 
frequency  with  the  highest  power  density  in  the  range  of  0.8- 
2  Hz  was  chosen  to  represent  pulse  rate  and  converted  to 
beats  per  minute  (60*fmax). 

F.  Heart  and  Pulse  Rate  Estimate  Comparison 

The  absolute  value  difference  between  pulse  rate 
estimation  methods  was  calculated  to  examine  the  accuracy 
of  each  method  as  compared  to  fingertip  PPG  with  individual 
BVP  identification.  Fingertip  PPG  was  chosen  as  the 
reference  due  to  its  known  correlation  with  ECG  at  rest  and 
better  physiological  correspondence  with  iPPG,  since  they 
both  rely  on  the  same  underlying  physiological  phenomenon. 
For  each  of  5  corresponding,  non-overlapping,  1 -minute 
windows:  (a)  heart  rate  determined  by  the  IBI  time  series 
from  ECG,  (b)  pulse  rate  determined  by  periodogram  of  the 
fingertip  PPG  time  series,  (c)  pulse  rate  by  periodogram  of 
the  long-range  iPPG  time  series,  and  (d)  pulse  rate 
determined  by  the  1PI  time  series  from  long-range  iPPG  were 
subtracted  from  the  pulse  rate  determined  by  the  IPI  series  of 
fingertip  PPG.  Group  mean  absolute  difference  measures 
were  bootstrapped  lOOOx  via  random  selection  of  one  of  the 
5,  non-overlapping,  1 -minute  windows  from  each  participant. 
The  95%  confidence  intervals  on  the  bootstrapped  means 
(1000  iterations)  were  calculated  as  an  indicator  of  the  range 
of  the  mean  absolute  error  distribution  for  each  participant. 

G.  Heart  and  Pulse  Rate  Variability  Measures 

To  calculate  pulse-  and  heart  rate  variability,  the 
corresponding  SME-corrected  IPI  and  IBI  time  series 
derived  from  long-range  iPPG  and  gold-standard  ECG, 
respectively,  were  input  to  the  CardioBatch  software 
package  [39J.  CardioBatch  was  used  to  calculate  frequency- 
domain  HRV  measures:  LF/THM  variability  (0.06-0.10  Hz) 


and  HF/RSA  variability  (0.12-0.40  Hz)  and  the  time- 
domain,  overall  variability  measure  SDNN  [40J,  [41 J.  To 
investigate  the  accuracy  of  PRV  measurements  derived  from 
long-range  iPPG  as  compared  to  gold-standard,  ECG- 
derived  HRV,  side-by-side  correlation  and  Bland-Altman 
plots  [42J,  [43 J  were  created  for  each  measure  of  HRV: 
LF/THM,  HF/RSA,  and  SDNN. 

III.  Results 

A.  Time  Series  Data 

Above,  in  Fig.  2,  a  characteristic  example  of  the  high- 
quality,  non-contact  iPPG  waveforms  recovered  for  19  of  22 
participants  at  imager-to-subject  distances  of  25  meters  is 
displayed.  Individual  BVP  waves  can  be  readily  identified  in 
the  iPPG  waveform  and  the  liming  of  the  pulse  waves 
corresponds  well  with  both  the  electrical  cardiac  activity 
observed  in  the  ECG  waveform  and  optical,  contact 
measurement  of  the  BVP  waveform  measured  at  tip  of  the 
ring  finger. 

B.  Heart  Rate  and  Pulse  Rate 

Corresponding  one-minute  windows  were  used  to 
evaluate  the  accuracy  of  heart  rate  and  pulse  rate 
measurements  as  described  in  the  previous  section.  Four 
pairings  of  windowed  cardiac  rate  measurements  were 
compared  on  basis  of  absolute  difference.  Each  measurement 
method,  listed  below,  was  compared  to  fingertip  PPG  with 
individual  BVP  wave  identification: 

(a)  Contact  ECG  with  individual  cardiac  cycle  identification 
(PPGipi  —  ECGibi).  This  pairing  represents  a  best-case 
baseline  comparison  between  measurements  of  cardiac  rate 
recorded  from  participants  at  rest. 

(b)  Contact  PPG  using  the  dominant  frequency  in  the  windowed 
periodogram  (PPGipi  -  PPGpsd)-  This  comparison  is  an 
estimate  of  the  anticipated  error  in  pulse  rate  measurement 
due  to  the  PSD-derived  method. 

(c)  Long-range  iPPG  using  the  dominant  frequency  in  the 
windowed  periodogram  (PPGipi  -  iPPGpso).  This  comparison 
shows  the  accuracy  of  our  previously  published  method  for 
the  detection  of  pulse  rate  using  long-range  iPPG  and  is 
subject  to  the  error  inherent  in  the  periodogram  method. 

(d)  Long-range  iPPG  with  individual  cardiac  cycle  identification 
(PPGipi  -  iPPGiPi).  This  comparison  shows  the  accuracy  of 
pulse  rates  derived  from  long-range  iPPG  using  IPI  time 
series  of  individually  identified  systolic  onsets  in  the  BVP. 

These  group,  mean  absolute  difference  measurements  were 
bootstrapped  lOOOx  via  random  selection  of  one  of  the  5, 
non-overlapping,  1 -minute  windows  from  each  participant 
and  are  displayed  in  the  boxplots  shown  in  Fig.  3. 

C.  Heart  Rate  Variability  and  Pulse  Rate  Variability 

To  investigate  the  accuracy  of  PRV  measurements 
derived  from  long-range  iPPG  as  compared  to  gold-standard, 
ECG-derived  HRV,  side-by-side  correlation  and  Bland- 
Altman  plots  are  displayed  in  Fig.  4  for  each  measure  of 
HRV:  LF/THM  (top),  HF/RSA  (middle),  and  SDNN 
(bottom).  The  plots  show  one  data  point  per  participant  (19 
total)  resulting  from  HRV  analysis  of  each  corresponding  5- 
minute,  IXI  time  series. 
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Bootstrapped  Mean  Absolute  Error 
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Comparison  Pairs 

Figure  3.  Bootstrapped.  mean,  absolute  error  in  pulse  rale. 
Comparisons  of  fingertip  PPG  with  individual  BVP  identification 
versus:  (a)  ECG  using  IBls,  (b)  contact  PPG  using  periodograms,  (c) 
long-range  iPPG  using  periodograms.  and  (d)  long-range  iPPG  using 
lPIs.  Error  means  were  randomly  bootstrapped  over  10(X)  iterations. 

Boxes  represent  the  first,  median,  and  third  quartiles.  Whiskers 
represent  the  95 %  Cl  for  each  bootstrapped  distribution,  with  the 
outlying  2.5%  of  points  on  either  side  plotted  individually. 


LF/THM 


Figure  4.  Side-by-side  correlation  and  Bland-Altman  plots  for 


measurement  comparison  between  PRV  from  long-range  iPPG  and 
HRV  from  gold-standard  ECG.  From  top  to  bottom.  LF/THM, 
HF/RSA,  and  SDNN  variability  measurements  are  compared. 


IV.  Discussion 

In  this  study  we  completed  a  further  investigation  into  the 
capabilities  of  long-range  imaging  photoplethysmography  by 
employing  a  high-quality  digital  camera  and  super-telephoto 
lens.  Previous  studies  have  typically  occupied  the  range  of 
imager-to-subject  distances  of  a  few  centimeters  to  a 
maximum  of  3  meters.  Our  recently  published  work  [21J 
demonstrated  measurements  of  pulse  rate  at  distances  of  25, 
50.  and  100  meters  by  employing  the  periodogram  approach. 
For  that  method,  mean  absolute  error  increased  with  distance 
as  signal  quality  diminished,  likely  due  to  the  decreased 
facial  region  size  in  the  image  as  well  as  the  greatly 
diminished  light  transmitted  to  the  image  sensor  with 
increased  focal  lengths.  A  relative  strength  of  the 
periodogram  approach  was  shown  in  its  ability  to  recover 
pulse  rates  within  2.0,  4.1,  and  10.9  beats  per  minute  of  mean 
absolute  error  at  imager-to-subject  distances  of  25,  50,  and 
100  meters,  respectively,  over  a  pool  of  22  subjects.  This  was 
possible  even  when  component  waveforms  were  very  noisy 
and  BVP  waves  were  indistinguishable  in  the  time  series 
data,  as  was  especially  true  at  distances  of  50  and  100  meters 
[21],  However,  a  weakness  of  the  periodogram  approach  was 
demonstrated  by  an  estimated  1 .34  beats  per  minute  of  mean 
absolute  error  contributed  by  the  periodogram  method.  This 
weakness  is  attributable  to  the  oversimplification  of 
estimating  an  individual’s  time-varying  pulse  rate  using  a 
single  dominate  frequency  within  a  given  windowed  signal 
where  other  noise  is  present.  In  this  work  using  iPPG 
waveforms  recovered  at  25  meters,  individual  BVP  waves 
were  identified  and  used  to  significantly  improve  the 
accuracy  of  the  windowed  pulse  rate  estimates  as  well  as 
enable  accurate  measurements  of  pulse  rate  variability. 

The  various  comparisons  of  pulse  rate  estimation 
methods,  shown  in  Fig.  3,  illustrate  several  important  points 
regarding  the  possible  choices  for  heart/pulse  rate 
measurement.  As  shown  in  the  Fig.  3(a),  pulse  rate  derived 
from  contact,  fingertip  PPG  and  heart  rate  derived  from  ECG, 
each  with  individual  cardiac  cycle  identification,  are 
essentially  equivalent  for  individuals  at  rest  with  every 
bootstrap  point  falling  below  0.18  bpm  of  mean  absolute 
difference.  This  correspondence  is  expected  based  on  a 
review  of  the  published  literature  [25 J.  Consequently, 
subsequent  comparisons  are  made  with  respect  to  the 
fingertip  PPG  data  with  individual  cycle  identification.  Fig. 
3(b)  shows  the  methodological  error  resulting  from  the 
periodogram  method  by  comparing  pulse  rate  estimation 
method  (individual  cycle  identification  vs  periodogram)  for 
fingertip  PPG.  From  this  comparison,  approximately  1.6  bpm 
of  mean  absolute  error  and  considerable  additional  variability 
is  attributed  to  the  periodogram  method.  Fig.  3(c)  shows  the 
absolute  error  distributions  for  pulse  rates  derived  using  the 
periodogram  method  for  long-range  iPPG  with  a  mean  error 
of  the  bootstrap  distribution  of  1.59  bpm.  As  recently 
published  [21],  much  of  this  difference  was  attributed  to  the 
methodological  error  resulting  from  the  periodogram 
approach,  by  analogy  to  the  comparison  shown  in  Fig.  3(b) 
for  contact  PPG.  After  completing  individual  cycle 
identification  in  this  study.  Fig.  3(d)  confirms  that  assertion 
and  demonstrates  a  significant  decrease  in  absolute  error  and 
thus  increase  in  accuracy.  The  mean  absolute  error  for  the 
bootstrap  distribution  was  0.22  bpm  with  all  individual 
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bootstrap  data  points  falling  below  0.83  bpm.  This 
demonstrates  that  very  accurate  measurements  of  windowed 
pulse  rate  can  be  achieved  at  long  imager-to-subject  distances 
up  to  25  meters  for  stationary  subjects. 

The  correlation  and  Bland-Altman  plots  presented  in  Fig. 
4  show  high  correlations  and  good  limits  of  agreement  for  the 
comparisons  of  heart  rate  variability  measures  from  long- 
range  iPPG  vs  gold-standard  ECG.  While  positive  mean 
offsets/  biases  are  observed,  each  of  the  HRV  measures  are 
well  correlated.  This  general  overestimation  of  short-term 
variability  is  expected  and  has  been  observed  in  several 
studies  of  contact  PPG  [25J.  These  results  agree  well  with 
other  published  estimates  of  heart  rate  variability  using  iPPG 
at  imager-to-subject  distances  up  to  3m  [30]-[35]  and  show 
promise  that  iPPG  may  be  used  to  assess  meaningful  health 
or  stress  states  as  shown  in  [31J,  even  at  long  imager-to- 
subject  distances. 

As  demonstrated  in  this  study,  the  significant 
improvement  in  pulse  rate  measurement  accuracy  and  the 
ability  to  recover  highly  correlated  (to  ECG-derived,  gold 
standard)  measurements  of  PRV,  even  at  exceedingly  long 
imager-to-subject  distances,  is  an  exciting  demonstration  of 
the  capabilities  of  iPPG.  For  stationary  subjects,  accuracy 
comparable  to  close  range  iPPG  measurements  of  PR  and 
PRV  was  achieved  using  a  consumer,  enthusiast  grade  digital 
camera  and  relatively  inexpensive  super-telephoto  lens. 
Despite  these  successes,  further  exploration  is  required  to 
better  understand  long-range  iPPG.  The  recovered  signals 
from  three  individuals  were  too  noisy  to  be  recovered  and 
signals  measured  at  distances  greater  than  25m  did  not 
contain  consistently  identifiable  BVP  waves  and  were 
excluded  from  analysis.  Additionally,  effects  of  subject 
motion  on  long-range  iPPG  were  not  studied  but  would  likely 
pose  significant  challenges  for  signal  recovery,  similar  to 
close-range  iPPG. 

Future  studies  may  evaluate  long-range  iPPG  outdoors  in 
daylight  conditions  when  measured  illuminance  ranges  from 
10,000  to  25,000  lux,  providing  10-25x  better  subject 
illumination  than  provided  by  the  artificial  lighting  used  in 
this  study  [44],  Additionally,  the  use  of  multiple  imagers 
recording  video  simultaneously  [45],  [46],  color  space  based 
methods  [47],  and/or  targeted  facial  regions  of  interest  [48] 
may  be  used  to  aid  in  iPPG  signal  recovery.  More  generally, 
the  effects  of  other  variables  of  interest  which  may  affect 
iPPG  signal  quality  including  participant  characteristics 
(skin  tone,  age,  gender,  facial  hair,  skincare  product/  makeup 
use)  and  varying  lighting  and  image  background  conditions 
may  be  examined  in  larger  sample  sizes  and/or  by  explicitly 
controlling  for  these  factors  of  interest.  Finally,  multi- 
spectral  evaluation  of  iPPG  may  be  used  to  examine 
potential  advantages  resulting  from  utilizing  spectral  bands 
other  than  red,  green,  and,  blue  as  recently  demonstrated 
using  a  five-band  (red,  green,  blue,  cyan,  and  orange)  imager 
i3oj: 

V.  Conclusion 

This  study  demonstrated  the  first  measurement  of  pulse 
rate  variability  using  long-range  imaging 
photoplethysmography  and  also  demonstrated  improved 
pulse  rate  measurement  accuracy.  At  a  distance  of  25  meters, 


iPPG  waveforms  were  recovered  with  very  good  correlation 
to  fingertip  PPG  and  ECG  for  19  participants  seated  at  rest. 
This  enabled  the  accurate  identification  of  individual  blood 
volume  pulse  waves  and  measurements  of  pulse  rate 
variability  (LF/THM,  HF/RSA,  SDNN)  and  windowed  pulse 
rate  compared  to  gold-standard  ECG.  Using  individual 
cardiac  cycle  identification,  as  compared  to  the  periodogram 
approach  to  measure  pulse  rate,  reduced  the  mean  absolute 
error  in  the  estimate  from  1.6  to  0.2  beats  per  minute. 
Correlation  analysis  (r2)  between  the  camera-based  measures 
of  pulse  rate  variability  and  ECG-derived  heart  rate 
variability  ranged  from  0.779  to  0.973.  These  results  are 
comparable  to  those  accuracies  previously  demonstrated  with 
imager-to-subject  distances  of  no  more  than  3  meters.  This 
study  demonstrates  that  pulse  rates  within  one  beat-per- 
minute  of  that  obtained  by  gold-standard  ECG  can  be 
achieved  when  the  recovered  blood  volume  pulse 
morphology  is  of  adequate  quality  to  resolve  systolic  onsets 
for  individual  cardiac  cycles.  Further,  this  same  approach  can 
yield  data  of  very  promising  quality  for  estimating  measures 
of  pulse  rate  variability. 
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